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ABSTBACT 

In placing the issue of the ethics of using 
anthropological methods for educational evaluation in the context of 
scientisi, anthropology and other social sciences are viewed as being 
in part either qualitative or quantitative. Furthermore, the 
difference between research and evaluation places the ethnographer in 
another position in relationship to those studied. , Two basic 
categories of ethical considerations are discussed: data gathering, 
including loyalty and employment of the field worker, methodology, 
and confidentiality; and the results of data collection, including 
the right of review, dissemination of findings, and Impact of the 
data* In Section B, entitled "The Interaction „of „ Ethnics_and _H 
some of the ethical issues involved in designing a research 
methodology are dealt with. . Comments are based on the experience of 
studying Project Follow Through using a group interview technique. 
(BW) 
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Ethical Considerations in the Anthropological Evaluation of 

Educational Programs 
Woodrow W. Clark Jr. April 197^ (AERA) 



Introduction 

The purpose oftthe paper is to highlight the contextual and 
processual problems in using anthropological methods to do educ- 
ational evaluations. The present author has used such methods 
as part of the evaluation of a teacher education program at a ;i 
major university. However, serious problems in both the definition || 
and intent of anthropological methodology arise. These problems ^ 
are considered below. ^| 
The paper is divided into four parts i (1) a discussion of 1:^^ 
the anthropological context fornevaluation; (2) the distinction -I 
between anthropology and other qualitative methodologies i (3) a ;| 
review of the ethical problems in anthropological evaluations? -^1 
and (^) a critique of the anthropological methodology itself . 
By way of introduction, the paper does not deal specifically 
with lengthy examples of ethical concerns in doing ethnographic 
field work. That task, I leave to my co-author. Several short 
examples are given, here, but only as illustrations. / :| 

I will use the terms anthropologist, field worker, ethnographer 3 
and qualitative researcher somewhat the same throughout the paper, YetH 
I realize that there are vast differences between all these designatloM 
I will make such distinctions later. For clarity sake, however, all 
these- terms apply to a particular kind of methodology which is ' 1^ 

m 



considered by most scholars to be oriented towards anthropology. ■ -'^ 




The Anthropological Context 



Consider the stage on which to review v the use of anthropological 
methods in doing educational (any kind) of evaluations. In thinking 
about the topic, I believe that the basic issue is: what is 
anthropology? Is anthropology, a science or an art form? I would 
agree with Eric Wolf's view that anthropology is the most human- ^ 
istic of the sciences. Anthropology is a science as much as 
psychology, sociology, or economics are sciences i they are all 
based upon observation, description, explanation, and prediction. 

I make this assertion because a sizable number of scholars within 
anthropology view the discipline as "merely descriptive" or as 
a "higher form of journalism." Then there are even more scholars 
outside of anthropology who see it as not being very scientific at 
all. The problem has to do with what a science is and what it is not* ; 

Most social scientists get concerned over the need for validity ^ 
and reliability. Since anthropologists tend not to, then the ; 
ethndgraphe9» is viewed as not being scientific. I would argue 
that such needs do not render a social science as being scientific* ^ 
As eicourel (1963) points out, there is indeed much to be qxiestioned |i 
about the use and reliance of measurement in sociology. OSiere is -^1 
no such thing as value-ftee social science. G. Wright MilisV / 
Ernest Becker, P. von Hayek, Irving L. Horowitz, Jules Henry, among I jl 
others^ provided amble proof of that. 

Across disciplines, there is a growing concern for social science Sii 
to be more humanistically oriented. Ironically, at UC Berkeley, ^^i 
the Anthropology Department appears to be headed in the opposite 
direction by offering a special program in quantitative measdrement. ?i 



The real question is what can anthropological methods do for an 
evaluator that other methods can not do? Here we get to the fringe 
argument of the paper. If anthropological methods are defined 
traditionally as Malinowski, Radcliff-Brown and others suggest, then 
anthropology can perhaps do very little • "Such methodologies are 
too costlyV is the usual response. That is, the traditional view . 
of ••doing anthropology" requires the ethnographer to be in the 
field at least one year with a particular culture. However, as 
recent private notebooks of Malinowski 's reveal, that mythical 
standard requirement is subject to question. MaJLinowski, himself, 
apparently wondered about the "time in the field" reqirement. 

Furthermore, even such a lengthy exposre, did not sensitize him 

to the cultures that he studied. Malinowski reveals that he hated 
such long field work periods, even though he imposed them upon 
his own students, while he equally disliked the. people that 
vhe studied. He lacked sensitivity all the way around. 

Nevertheless, the basic method in anthropology is participant- 
observation over a long period of time. If we use that standard 
to measiire good from bad educational evaluation that ulitizes 
anthropological methods, then we need to reformulate exactly 
what other anthropological methods are being used. Perhaps a 
more viable distinction, than the disciplinary one, is to talk 
about Quantitative and Qualitative methods. 

Quantitative and Qualitative Methods 

Within anthropology, there are ethnographers who use quantitative 
methods t ^sucH^^^M surveys, questionnaires, language categories, ,:v 
demographic techniques, etc. These are the same methods used by 
most sociologists, psychologists, and economists. Qualitative 



methods also cross-cut discipliWsi participant-observationt group, 
discussions f interviewingt key informants, etc. In doing educational 
evaluations, the quantitative methods have been the most pervasive. 
However» some qualitative methods are becoming increasingly popular. 
Apt Associates used qualitative methods in its evaluation of 
several experimental school projectsi ETS similarly relied heavily 
upon such methods in its evaluations of career education programs; 
and a growing number of other evaluators are tiirning to the use 
of qualitative methods in evaluation and research. Par West 
Educational Lab is experimenting with the •'ethnographic description 
of classrooms", while a research project at UC Berkeley uses 
classroom observations to measiore behavior. 

I will not review all the argionents for the use of one methodology 
over the other. My intention is simply to point out that disciplines 7 
do not constitute the differences; instead the orientation of the 
evaluator seems to dictate the use of one set of methods over another^;- 

At the theoretical level, however, there is a very important J 
distinction between qualitative and quantitative methods. The Issue > 
again revolves aroxind the concept of what is a science? The vi 
predominant social science paradigm (Kuhn, I968) does define science 4^ 
very much in the same way as the hard or natural sciences (Blxmer»1975} 
Many anthropologists have argued that the "science of culture" too :t| 

. ■ ' ■ . '■■ ■ ' 

must follow that hatd science model. On the contrary, I would :;| 
argue that such a paradigm is not only false when applied to ' | 

the study of human beings, but also destructive when attempting :| 
to ttiderstand the way people live together (Clark, 1970). 

Blumer (I969) in sociology and Chomsky (I968) in linguistics 
have argued that the predominant social science paradigm only 
considers human beings as neutral organisms through which certain 



factors cause predictable behaviors, Thusi the study of a person's 
rolt can predict what action an individual will take; or the 
understanding of one*s motivations reveal their future behavior. 
Such arguments ignore individuals as thinking beings who interact 
daily with other human beings. Bl-umer, correctly points to the use 
of symbolic interaction while Chomsky notes language as evidence 
for human beings as thinking, interacting animals. 

Most quantitative researchers would argue that they are not 
ignoring people in their analysis t but the evidence of their 
studies seems to tell another story. The deep split within 
sociology between the survey researchers and the symbolic interact- 
ionist demonstrates these differences. Wilson (1970) refers to 
the former as the "normative "paradigm and the latter as the 
"interpretiuti- paradigm. Garfinkel (196?) who coined the term 
"ethnomethodology "argues th^ quantitative research must be"indexed*^ 
or grounded in the. culture of the people studied. Cicourel neatly 
demonstrates how this is done in a series of research studies i 
educational decision makers (196^^), language usage (1975)» and 
fertility in Argentine (197^) • All of this research is predicated 
upon the this ore tical need to treat people as interacting human 
beings rather thsui quantitative variables. \ 

Another analytical distinction concerning anthropological 
methods must be madet the difference between research and evaluation^ 
I have been using them coterminously; but they are not. Several 
research psychologists in evaluation who read my 'paper on 
••Qualitative Mehods in Educational Evaluation" (Clark, 1975) remarked 
"that is not research." In other words, they felt tint the qualitative 
research lacked the basic "scientific tenets of psychological 
research." They meant, of course, the paper did not discuss the use 



of an experimental design with pre/post tests, control/experimenti 

groups^ and statistical procedures. While I could argue with these 

*^cientific"assumptions, suffice it to say that the respect given 

to psychological methods by social scientists should be the same 

respect given to anthropological research methods* Pew scholars 

question the matching control groups of the psychologist or the 

statistical methods of ^surv6y .sociologist. The same methodological 

respect should be accorded trained anthropologists in their research. 

As the sociologist, Herbert Blumer put iti 

Respect the nature of the empirical world and organize a 
methodological stance to reflect that respect (1969t6o). 

Nevertheless, in anthropology, there are at least three differences 

bet'/^een research and evelaution. First, the nature of evaluation provides 

the researcher with a given population or a specific program. In reseemch 

the topic is the choice of the investigator. In evaluation, the subjects 

are there and aware of the investigator's intent to evaluate them* 

Secondly, the purpose of research may be to piirsuejan issue or problem 

of interest to the researcher. In evaluation, the purpose is to provide 

some data back to the subjects (formative) and report to the funding 

agency (summative). The difference can be seen in the distinction 

between a contract and a grant (or independent field work). The contract 

Obligates the investigator to periodically report to the funding 

agency. As one fieldUorker, under a contract, described the situation! 

The contract between the funding agency and the local school 
district strikes a devil's bargains the funding agency will 
underwrite educational change, provided that the school district 
will allow itself to be used as a research site through the 
life of the project (Clinton, 1975«200). 

In doing' research independently or through a grant, such a "devil's 

bargain** need not be made. Independent research (M»t evaluation) does 

not entail periodic reports to a funding agency. 



Finally, evaluation must be judgfimental» By its very nature, evaluation 
of people and programs (their livelihood) separates out what works 
from what does not work. Since most evaluation follows the educational 
psychological paradigm of formative and summative data collection! 
distinct periods of judgement are set aside. In research, the investigaLtor 
need not be constrained by these formal sessions or reports • Further- 
more, the researcher does not judge the value of the subject or program. 
Instead s/he describes ^nd attempts to understajid the interaction of 
the people involved, . 

Both quantitative and qualitative researcher have the same basic 
constraints when doing evaluations of any kind of program. The ethical 
issues, however, become more pronounced for the qualitative evaluator 
simply because s/he is in closer contact with the people being evaluated, !V ' 
The consequences of the evaluation become far more personal to the 
evaluator. This is not to suggest that the qualitative evaluator is 
more subjective than the quantitative evaluator. Quite the contrary, 
the former is more sensitive to the everyday lives of those studied-— 
in terms of the total project and its effects on the people's personal 
lives. Such sensitivity can be much more of a valuable evaluation than 
the fxirther removedr^and more self-sub jective (jaantitative evaluator. 
It is here that the ethical issues must be carefully considered, ' ' ''v. 

Ethical Issues and Results • irv 

~ .III 0^.. 

. ii 

First, consider the ethical issues involved in gathering qualitative | 
datas loyalty, employment, methodology, and confidentiality. The most | 
obvious ethical issue concerns the loyalty of the field worker. To whom 
is the ethnographer responsible? In normal research, the field worker • V | 



is ultimately responsible to him/herself. Secondly, the anthropologist 
is responsible to. the people under study. However, as an evaluator, 
the priorities for responsibility have changed drastically. The 
ethnographer is first responsible to the funding agencyi secondly,' 
to. the people studied; and finally i to hiffl/herself • In other words, 
the field worker is gathering data, often confidential and sensitive, 
for someone else. Field notes, technically, are the property of the 
funding agency. The people under study, potentially, could be in great 
danger I loss of funding, personnel action, or private information 
becoming public. Loyalty becomes an important ethical issue. 

Excerpts from "Guidelines for the Collection, Handling, and Use 
of Data" for another federally funded project which uses field workers 
mkkes the loyalty problem very clean 



The data will be kept secure and will be used only for legitimate ::: 
work to improve urban public education in accordance with the 
principles of these organizations.... The federal agency supporting^ 
the research must determine if the research potentially puts 
subjects at risk of physical, sociological, or psychological 
damage and if the research puts subjects in situations substahtialXsi 
different then their normal day to day situations.... Recent i-M 
government guidelines require all federally funded projects {to V^f^l 
* make available to individuals all data records which are idehtiflab£i 

to those persons.... While a person is employed by .../they I have, 
responsibility to clear all pxiblications, presentations t etc; . ••'•^1^ 
Also, if a site researcher quits before the documentation work/ ^^^^^ 
is over, sAe has the obligation to share the notes with \ / :;^r^ 
person hired to replace himAei"* • • •(CNS,1975) • ;; 'i;:v: i - TI^ 

While this particular project took steps to insure the "protection of .-'- 'fM 

human subjects" and delated data therefrom, the fact is that the ; 

field worker is ultimately responsible to the funding agency. The '-M 

ethnographer must give herAis loyalty to the source of the funds and:^^^^^^^ ]^ 

not to the people under study. The determining factor can easily becomie - 

^ ■• ^^...-.^ -..-.^ 

the field workers own employment. 

\ Another ethical issue in ethnographic evaluation, therefore, coneernsf 




employment s The field worker who is evaluating educational' programs, 
may appear to be "better ethipally" employed because s/he -has a 
position in educational evaluation which is often viewed as a pojsLtive 
non-university position. What if the field worker were asked to 
evaluate programs for the Array or the Navy? or for IBM?or Bank of ; 
America? In other words, are some positions more desirable and hence. 



more ethical t than others? In a shrinking academic job market, counter- 
balanced with an increasing niamber of trained anthropologists, some \ 
of; the less desirable and ethically questionable positions for the | 
ethnographer, as evaluator, become more appealing. Economic STirvival\ 
becomes part of the overall ethical issues. We could also ask the 
same question about the ethics of employment in education and academia 
themselves. What makes an university professor any more ethical? If 
the activists' argtiments in the 1960s over relevancy, power, and th^ 
academic establishment still apply to the present day, university \ 
profeissors are no better ethically than they ever were. Thfc saune \ 
point ! applies to educational evaluators» The field jworker is often -; _ V 
met with hostility and suspicion. The people, under evaluation, often 
attempt to hide pertinent problems and construct elaborate obstacles 
/:for the ethnographer. In large part, the people studied are also 

concerned about their future employment. / 
r The third ethical issue involving field workers in evaluation directly 
concerns the. topic of the ethnographic method itself. As the field 
worker attempts to landerstand a program or group of people, . s/he is 
building up trust between the program personnel and hisv^erself. Thus, ^ 
participant-observation, as the constant research activity of the fiiffld^\^ 
worker in the daily activities of the program, provides the ethnographer ^ 
with an intimate knowledge of the program's operation. Does the field r : 
worker report everything? no matter how damaging? How critical oanP- - '^ 
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th9 sthnographer be? and for what reasons? 

The exact rationale for ethnographic research as evaluation, that 
is its ability to understand the inner workings of a group of people, 
provide the field worker with an ethical dilemma. The ethnographer 
might be sympathic to the program's ideals, for example, but not to 
the program's actual operation. What does one do? Furthermore, the 
field worker is in a position of damaging individuals, the program 
itself, and even the funding agency. If the field worker uncovers 
critical data, then what happens to it? Should the program staff be 
alerted? Should the ethnographer make suggestions? Should the ethno- 
grapher get involved, as a participant to make corrective changes? 

Finally, confidentiality: , is an important aspect of ethics involving 
ethnographic evaluation. The issue has been suggested above, but warrants 
special attentiont What does the ethnographer when s/he uncovers 
very private information that is pertinent to the entire operation 
of the people studied? The problem becomes paramount in attempting 
to separate private from public data. However, the issue is similar 
to the dilemma that the ethnographer typically faces in doing any kind 



of field workt does one describe the ideal or real culture? The former 

* • . ■ , : • . '^^:^^^t::r-y^ .. 

tends to be ;the way that the culture is supposed to work, whilis ' the 

lu^^ ^ latter emphasizes how people really interact. For evaluative surposes, 1 

^ the ideal culture may be what the people studied want reported, jirhile . | 

.■V- .' . -'V . ■ ■ ■ ' , ■ ^!^\^:r:^\^^'f*i''': f 

; 7. the funding agency w^iiits to' know the reality of the situation.^ The 

ethical dilemma for the field worker might once again be problematic • 



Condientiality also covers the problem of who owns field notes, 
audio and visual tapes, as well as photos and other dociaments. As tbe 
statement ' from one organization (above) indicates, the ethnographer' 
should be able to claim primary ownership. Yet again the issue gets 
complex when under contract work the money for supplies, tapes, '^etc. 



P^^^^^^f ^"^^^m agency. An ethnographer would be#eiif 

ERIC • ■■ -^t^^^^^- ■. 1:2-^.. r--^^^^ 




advised to he sure that these issues are clarified prior to or shortly 
after engaging in the field work. One partial solution suggested by 
some employees of the National Institute of Education in Washington, 
perhaps as a post-Watergate thought, is to separate data into a 
contract and personal file. 

The second broad area of ethical issues concerns the results of 
qualitative data collectiont the right of review, dissemination of 
findings, and impact of the data. The right of review is an essential 
issue in the ethics of educsTtional evaluation. Once the report i|| 
in a draft form, who gets to see it? Most ethnographers would be sure 
to have the people studied review the data to catch misunderstandings 
and for clarification purposes. However, in doing evaluations, the 
ethnographer might find the people studied to be defensive and protective - 
of their own interests. Hence, "cover-up" becomes a pbssibilityuwheiiiShowin 
the report to the people who are being evaluated ► 

At another level, the funding agency may want to review the data 
before a final draft is submitted. Other colleagues and scholars may 
want to review the data collected. As more people review the material, ^ 
the data becomes further removed from what the ethnographer actually .J 
Studied, through editoral changes, academic language added, and theory 
impossed...L ■ • v., . •. / .. ■ •■• • 

Likewise, dissemination of the findings proves tote an ethical problem..^ 

' — ,v^-i;r'^rRi. 

The people studied are likely to be viewed as subjects in a xiaturallstic^y 

experiment. The final report may indicate that or it may be constructed 

in the traditional anthropological manner of a case study. In either 

event, the language and emphasis of the report may be more reflective -..^ 

of the funding agency than an attempt to provide an understanding of '^l 

■ ' ■ ■;. ..- . . •■•■.iH 

the people interacting in a particular program. » # 
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Publication or presentation of the data to public audiences raises 
other dissemination concerns . The use of data gathered as part of an 
evaluation process takes on a different meaning if it is made public. 
In the first place, the people studied must be clearly aware of such 
an intent for the data collected • And secondly t the use of the data 
for a larger audience should meet with the approval of those studied ^ 
as well as the funding agency. Once the ethnographer leaves the employment 
of the funding agency, the issue becomes more problematic. 

Finally, the impact of the evaluation upon the project becomes an 
ethical issue for data distribution. The ethnographer as evaluator 
may have some valuable ideas to suggest to the people studied. These 
suggestions may be based upon the data collected. But who do the 
suggestions go to? for what reasons? and does the ethnographer then 
become an advocate? The problem is that an ethnographer as an evaluator 
will find it difficult not to intercede in the on-going processes of 
the people studied. Unlike research, an evaluator should not be inserting 
judgmental statements about the program with the intention of changing it». 

The use of formative evaluation sessions might be very appropriate 
for the ethnographer to provide the program with helpful ideas and v 
/suggestions. But even then, the matter becomes triclQr since the people 
(studied may hot like the ideas and thereafter be suspicious of the / 

• ethnographer's role as evaluator. The personal dilemma for the 

• s ■ ■ ' ■■ : ' ' -v;'v'- v.'/ .• 

• ethnographer may be enough to make him or her resign the po^bbion of 

evaluator. ^ > ; 

Critique of Anthropological Methods 

. - ^ . • * ■ 

Consider now a critical examination of anthropological methods, as 
part of the overall ethical concerns. The immediate issue is with the , j,;. 
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anthropological tradition of doing pure descriptive ethnography. 

Anthropological research uncovers essentially the educational process^ 

of learning one's culture. There are variations to the parameters of 

process. The point is that within anthropcaogy, there are enumerable 

"Theories which guide methodological approaches to research. 

Secondly, along the same lines, descriptive analysis tends to be 

static. Thus a definition of education, as cultural transmission, for 

example, may be entirely different from the definition assumed in a 

particular program. As Travis Hirschi, a social psychologist, noted 

in discussing The Causes of Deling uency i 

The school does more than prepare students for the future. It 
acts also as a holding operation! it attempts to engross and 
involve students in activities that are or may be essentially 
irrevelant to their occupational futures (1969il91)» 

Education has been criticized on more extensive grounds. But Hirschi's 

point is weljl taken in that the researcher (evaluator) may have entirely 

different perspectives of the school or learning environment than other 

scholars as well as .the participants. .v 

The ethnographer, thirdly, who applies his/her skills to policy- 

oriented research runs many methodological risks* Some have been 

mentioned earlier, such as access to data, validity, and the . degree . 

[i^ of involvement. The problem becomes significant when the field worker -.^i 

receives constant, and often contradictory signals ftom the funding/ .S^ 

-II agency or the immediate intermediary organization* In doing field , ^ 

work, the anthropologist must be free to experiment and move without 

interference. But due to the constant communication, directions, and 

control by the outside groups, the methods can no longer be those of 

the individual ethnographer geared to a particular culture, program 4 

or group of people. 



r.' 
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Ethnographic methods t themselves, can be full of serious problems* 
In social psychology, today, there is a trend toward using so-called 
ethnographic methods without really understanding what they really 
are and what their limitations can be? One project, that I am aware 
of, emphasizes what it calls the "ethnographic approach to classroom 
evaluation." However, unlike anthropology, the approach places ••field 
workers" in classrooms to observe only for several days. The researchers 
then go on to other classrooms to do the same "field workvl^A team of 
five such field workers (trained in a matter of days) covers eight 
cities and several dozen classrooms in three months. This is, of course, 
a perversion of what the antliropologist means by the ethnographic 
method. The sole purpose of such a project is to tabulate and quantify 
as many behavioral observations as possible. The problem is t>fv^t the 
evaluator has not carefully considered what e.thnography can and can 
not do. Other kinds of anthropological methods might be more useful 
in doing evaluative work. A§ noted earlier, these techniques are part 
of the qualitative methods found in other disciplines! interviewing, 
key informsmts, group discussions, selected problem pbserva^tions, 'etc., „ 
^ Finally, the field of anthropology has no certification process^ 



That is, anyone could call him or herself an anthropologist Having /' ; 
a Ph.D. in anthropology apparently does not restrict those who see -/ ; 
themselves as ethnographers. This is probably just as well, but it' '7^^^^ 
certainly causes problems in determining who is and who is not an ^ '''^•'M 
anthropologist. It also causes concern over the attempts to make 



anthropologists ethically responsible for their behavior (Berreman, 1973) • 
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Conclusion 



In sumraaryt I have attempted to place the issue of the ethics in 
using anthropological methods for educational evaluation in the context 



of scientisin. I have pointed out that anthropology and other social 
sciences must be viewed as being irJ^art either qualitative or quantitative 
The distinction helps clarify some of the ethical issues. Furthermoret 
the difference between research and evaluation places thJ^ethnographer 
in another position in relationship to those studied. • 

I have reviewed two basic categories of ethical considerations! 
data gathering and the results of data collection . Within each, I have 
discussed the various ethical issues without offering explicit 
solutions. Finally, I have attempted to critique the use of anthro- 
pology as a method. 
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SECTION B; THE INTERA.CTION OF ETHICS AND METHOD 

This section briefly outlines the methods used and 
ethical issues confronted in one educational research study 
influenced by anthropological perspectives. The purpose of 
the study has been to doci:unent the lessons learned by various 
participants in a federally- ftinded innovative educational pro- 
grain called Follow Through, The lessons learned study was 
one component of a larger project to describe the implementa- 
tion procedures developed in Follow Through over many years 
of trying to treuislate theoretical concepts about teaching 
and learning into operational programs that have to work in 
the practical world of public schools. 

The original impetus for this study came from the recpg- 
nition that the people involved in the Follow Through program 
have had importetnt opportunities to learn from direct exper- 
ience about the difficult process of implementing innovative 
educational programs. The Follow Through progreun has a 
number of features that make the lessons learned from its 
experiences especially valuable to document. One of these 
is parent participation, which helps link the schools to 
the home and the broader community. Another feature is 
"planned variation," which means that a wide variety of 
educational approaches is represented in Follow Through, ajid 
in comparing these it is possible to discern general rules 
or principles of implementation that hold across diverse 
educational philosophies, practices and local circumstances. 
Participating local communities are located throughout all 
the States in widely differing ethnic, cultural and geo- 
graphic settings. Another feature of Follow Through is the 
commitment of the funding agency, the U. S. Office of 
Education (USOE) , to a longitudinal research and development 
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effort in which the sponsors of various educational approache 
have been in continual interaction with the same local commun 
ities for up to seven years, which provides a considerably 
expanded time frame for experiencin/j the problems and achieve 
ments of educational change than the more typical short-term 
project allows* 

Documentation of what has been learned in Follow Through 
is an important step in making it possible for others to 
draw on this knowledge. This suggests an important question: 
Who are these other persons for whom the doctimentation is 
produced? The attempt to answer this question involves the 
researcher in important methodological and ethical considera- 
tions • If the audience for the research report is defined 
as the academic research community, in all likelihood only 
a small proportion of those people interested in education 
will ever draw on the results, for the conventions of aca- 
demic scholarship mitigate against wide readership. If, 
on the other hand, the audience is defined as the lay public, 
the conventions involved in encouraging wide readership are 
often labeled "unscientific" or "artistic" or "journalistic." 
Methods appropriate for producing information useful to aca- 
demic scholars are not always appropriate for producing 
information useful to public school educators, parents and 
other citizens concerned about schools. Questions about 
appropriate methods caimot be fully considered without 
reference to ethical issues like : Who has rights to the 
information developed by the researchers? Who should be 
the target audience for the research results— -academic 
scientists, public school educators, educational policy- 
makers , parents , the general public? 

Obviously there is no single best way to deal with 
issues and questions like these. The intent of this pre- 
sentation is to briefly illustrate Horw issues like those 
raised in the first section of this paper operated to shapj?-- 
one effort to use anthropological perspectives and methods 
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in educational research. Certainly the intent is not to 
suggest that this one way of dealing with these issues is 
somehow the best way. The major point being developed by 
this example is that researchers make certain decisions 
based on. essentially ethical considerations, and these 
decisions in turn influence the methods used to carry out 
the research. Sometimes differences of opinion about the 
methodological adequacy of a particular piece of research 
can be productively refocused by recognizing that the 
differences may be rooted in ethical considerations. 

For example, the decision was made in the Follow 
Through implementation study to try to present the research 
results in such a way that readers with widely varied back- 
grounds and interests could make use of it. This decision 
was made on the basis of essentially ethical considerations, 
for the researchers held a moral belief that it is right 
and proper for information about a public program like 
Follow Through to be made available to as wide an audience 
as possible. In this case the researchers were encouraged 
by the funding agency to act on that moral belief. The 
fundamental decision that shaped this research project was 
the decision to try to make the findings available to a 
varied audience. This was an ethical decision that had 
methodological implications . 

4 major issue for presenting information to readers 
with varied characteristics is whether the study would be 
seen as basically descriptive or evaluative; the question 
is whether a descriptive study of implementation is possible 
without implicitly assuming an evaluative role. The research 
staff's perspective was that this study should try to des- 
cribe the procedures used in Follow Through and it should 
not attempt to make judgments as to which strategies are 
the most effective. It was recognized, however^ that any 
potential audience would want some kind of indication as to 
the effectiveness of various procedures or strategies 
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employed to Install and maintain em innovative educational 
pro^eun. It was suggested that statements by participants 
theroselves^-sponsorsy parents, school staff, etc*— —could 
be relied upon as a means of reporting what was found 
effective and that such statements would sufficiently meet 
the needs of those interested in the question of effective- 
ness* As one consultant pointed out: 

••If we're going to try to say something about 
what has worked and what hasn't, that doesn't 
necessarily force us into a big program of 
classroom observation or anything of that kind. 
We really can rely: on some descriptive state- 
ments from the peoplia who've been involved 
about what worked and what didn't work." 

Tlie basically ethical premise that people can be 
trusted as sources of data is seen operating in this state- 
ment. One methodological implication of this ethical pre- 
mise led the research staff in the direction of trying to 
find ways to tell the story of Follow Through as much as 
possible in the words of th j participants themselves. It 
was also felt that using tT^e natural language of partici- 
pemts would be an effective way to communicate with a 
varied audience. 

The research procedures thus emphasized the discussion 
of the lessons participants themselves report that they 
have learned about Implementation procedures as a result of 
their involvement in the Follow Through program. Although 
it would have been possible to derive some of these lessons 
from suirvey questionnaires and from written descriptions of 
training and other implementation strategies, the research 
staff believed that the most vital source of this kind of 
data was the direct, first-hand reports of Follow Through 
participants themselves . 

Tlie most productive strategy for collecting data on 
the lessons learned focused on open-ended interviews with 
individual practitioners and especially on group seminars. 
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A group of persons that held various role positions in Follow 
Through, such as administrators, trainers, teachers and 
parents would meet together in an informal seminar-like 
setting to talk about what they had learned from their 
Follow Through experiences. The field researcher would lead 
the seminar session in such a way as to promote a free-flowing 
open-ended exploration of questions such as the following: 

Imagine that a person responsible for planning a 
new educational program comes to you to ask your 
advice on how to design guidelines for the new 
program* Based on what you've learned in Follow 
Through: 

How would you describe the main features of 
a prograjn that influence implementation? 

What makes each feature important? 

What features are worth keeping intact? 

What should be modified or refined? 

What should be discarded altogether because 
it doesn't work? 

\rtien asked to give a brief description of Follow 
Through by someone unfamiliar with the program, 
what features of the program do you talk about? 

What smalogies do you-use^ what key stories are 

told, what charts are draim, etc .? 

What elements could be taken away from Follow Through 
implementation and yet retain a viable educational 
change program? What are the key features—the 
essential features? 

How do you explain or account for the impact of Follow 
Through on the educational enterprise in Follow Through 
communities? 

How should we present information about Follow Through 
to others? (Format , diction, etc* ) 
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What aspects of the educational scene do you vgmt 
to have control over? e.g., 

• classrooms 

• school buildings 

• school districts 

• coimniinities 

• teacher training institutions 

• state departments of education 

• federal agencies 

• others 

What, in fact, do you have control over? 

iiThat have you found impossible to control? 

If you were to undertake related educational acti- 
vities in a new school setting: / 

What conditions do you consider essential for 
successful implementation? 

Irtiat conditions do you consider facilitating 
but not essential? 

What conditions do you consider a hindrance 
to implementation? 

What conditions would be certain to- cause 
failure? 

Is there amy thing that we have left out of the descrip- 
tion of your program or the- lessons learned that you 
think should be incorporated? * 

These seminars sometimes had several persons from the 
same or closely related role positions, such as a group of 
teachers and paraprof essional teaching assistants, and these 
could be as productive as those with widely varying role 
positions represented. The seminars sometimes lasted for 
about ail hour, but more typically \>rere two to three hours 
in length. It was often after the first hour that the 
group warmed fully to the task and the most useful informa- 
tion was developed. The groups remged in size from two or 
three up to about 25$ but most sessions were with five to 
ten persons. 
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In the data collection visits to the 13 sponsor home- 
shop organizations we typically met in the seminar format 
two or three times, with persons with different role posi- 
tions at each* Usually one seminar session was held with 
those connected to the training function, such as those who 
design and carry out training workshops and produce training 
materials* ^\nother seminar was sometimes held with those 
associated with the monitoring or evaluation function* 
Almost always there was at least one seminar with people 
drawn from different role positions, such as administrators, 
materials developers , trainers suid evaluators * Seminars 
were also held in each of the 13 local communities visited, 
one associated with each sponsor* Several persons from the 
same role position, such as parent members of the Policy 
Advisory Council (PAC) , would often meet together* Members 
of classroom teaching staffs often comprised seminar groups* 
Seminaxs with persons from various role positions usually 
included persons such as the local project director, the 
superintendent or someone else from the district central 
office, a principal, a local trainer, a teacher, a family 
outreach worker, a parent, and sometimes someone like a 
nurse or librariaji* 

Participants in these seminars often remarked to the 
researchers that the opportunity to look at their own 
operations in this kind of setting was exciting and pro- 
ductive* They often were led to see implications of their 
operations through their shared exploration of these ques- 
tions which were aimed at a level of generalization con- 
siderably more abstract than their typical day-to-day 
interchanges* The sessions served for the participants as 
an opportunity to take stock of whore they had come from 
and to do some thinking from a long-range planning perspec- 
tive about where this might take them* In this sense, the 
lessons seminar format could be viewed as having potential 
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for an on-line meuaagement tool for program participants 
as well as being viewed as a component of a social science 
documentation effort* 

These lessons seminars were just part of a larger 
project to describe Follow Through implementation procedui'es. 
The research project was begun with an information base 
gained from previous experiences with the Follow Through 
program. The author had previously served as the liaison 
between each sponsor orgeuaization and Steuciford Research 
Institute 9 which was conducting the national evaluation of 
Follow Through. In a previous project at Nero and Assoc«- 
iatesy sponsor-produced materials like theoretical position 
papers 9 training manuals and evaluation instruments were 
collected into a library and described. For the two-year 
implementation study, five researchers conducted field visi- 
tations at 13 different sponsor headquarters and one local 
community for each sponsor. Open-ended interviews were held 
with about 300 people from different role positions, such 
as administrators, trainers, parents and teachers, about how 
things get done in Follow Through, and seminars were con- 
ducted with most of these participants about the lessons 
learned from their Follow Tlirough experiences. Most of 
these interviews and seminars were recorded and approximately 
100 hours of tape were transcribed, providing a data base 
expressed in the words of the participants themselves. 

Now that the fund£unental ethical premises and the 
resulting research procedures have been briefly outlined, 
the discussion can turn to how some of the other issues and 
questions raised by the co-author in the first section of 
this paper apply to this research study. The fact that five 
researchers shared the responsibilities of visiting 26 
sites across the country meant that the traditional anthro- 
pological convention of long-term participgmt observation 
in one localitv was not followed. This research stands 



impersonal survey research of* the quantitative social 
sciences. Each field visit was several days in length, 
which provided some opportunity for observation of on- 
going activities in classrooms, advisory committee meetings, 
training sessions , etc • , as well as Tot inrorraal personal 
contacts with individuals outside of regular school contexts. 
The author was reuniliar with several of the sites visited 
because of his previous Follow Through work in them. This 
meant that some sites had been visited once or twice a 
year for about one week each over a four-year time period. 
So the data collection interviews and seminars were con- 
ducted by persons who had in-depth knowledge of the program 
being studied aJid warm personal relationships with many of 
its participants. 

Perhaps the methodological approach used in this 
study is closest to that of oral history in that the basic 
data source is the recorded talk of participants about their 
experiences in £Ui historical event—Follow Through. Here 
again, it can be seen how ethical premises interact with 
methodological procedures. From oral history comes support 
for our basic faith as hiaraan beings carrying out research 
that other human beings (the program participeuits) can ajnd 
will speak truthfully and cogently about their experiences, 
and that yet other human beings (the readers) can learn from 
this speech once it is re-organized and transposed into a 
non- technical written form. 

The basically ethical commitment to rely on the natural 
language of participants also has involved considerations of 
methodological issues explored by those interested in ordin- 
ary language philosophy. (For example, see V/ittgenstein, 
1953; and Cicourel, 1963.) 

From ordinaxy language philosophy there comes a mixed 
attitude of restrained skepticism and profound respect 
+/nvaT»H i''he% r?siTiah-i 1 i A« of evervdav lanmiafire« On the one 
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lin^istic utterances are so little understood by specialists 

that to rely on language for scientific enterprises is at 

most a dubious practice. On the other hand, these everyday 

utterances have served as the chief meeuis for recording, 

manipulating and transmitting human knowledge (at least 

until very recently). Despite the quibbles and questions 

about the adequacy of ordinary language to cdmmtmlcate 

"truth," it is also the chief language used in the conduct 

of the educational enterprise which was, after all, the 

object of this inquiry. 

This research project is part of the qualitative, 

humanistic tradition of social science. A Follow Through 

participant emphasized the importance of the htimanist 

perspective in the following words: 

"A study of Follow Through has to come out of a 
study of the people. It has to come out talking 
about the people. It can* t come out talking about 
the program and that kind of stuff, because we 
are not a program—we're people." 

As such, it is important to consider the ethical issues 
raised by the co-author regarding the loyalty of the field- 
worker, the confidentiality of the data, the rights of 
review and the dissemination of the findings. These kinds 
of issues are related to the fact that qualitative research 
methods bring researchers and subjects into personal rela- 
tionships as human beings. In this study the researchers 
have tried to deal with these issues from the basic ethical 
premise of trusting other persons, which also implies a 
concomitant ethical responsibility to be trustworthy as 
a hiiman person and reseai^cher. The ancient human precept of 
"doing unto others as you would have others do unto you" 
has sei*ved as a touchstone for considering the ethical 
implications of this research. Of course in the real world 
the potential for wise and considerate action is conditioned 
bv** limitations of perspective and options. Ethical dilemmas 
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constraints with humaji intentions ajid understanding's* Xn 
research, as in life, it is not always possible to know how 
to act, nor is it always possible to act in accordance with 
what you know* Ethical perspectives suid inethodologrical 
procedures are inevitably intertwined* Thus the actual 
conduct of this study was influenced by a kind of pragmatic 
ethical premise; In the world of day-to-day realities there 
is much virtue in simply cariTying on with the business at 
hand, given what you believe arid know how to do in the pre- 
sent moment, and given your willingness to learn anew and 
change and adapt as problems emerge* 

It would not be accui'ate to claim that this research 
study utilized traditional ethnographic methods, but it 
seems fair to say that it was influenced by anthropologica^l 
perspectives* Like anthropology, this approach to research 
holds that important knowledge about human affairs can be 
gained by observing those affairs in their natural setting 
and by interviewing participajits about what is going on* 
One of the important tools for accomplishing this is the 
comparative method in which cultural features from one 
natural setting are compared to features from other settings* 
Using concepts like culture and social structure, anthropolo- 
gists try to organize their own perceptions and those of 
participants into a coherent account that makes the phenomena 
under study somehow understandable* In this study we have 
visited people in the places where they live and work and 
have talked to them about their lives and Jobs* In the 
effort to understand what can be Icnown about producing 
change in schools , sponsor organizations and communities 
have been compared to each other to try to discern what 
cultural and social structural regularities are operating in 
the process of implementing inn ative educational programs* 

The suithropological concept of cultural relativism 
holds that each culture makes sense in its own terms to 
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inappropriate to apply the steuidards of one culture to Judge 
the worth or efficiency of another culture. In this study 
the concept of cultural relativism has operated much like 
an ethical principle in that the researchers accepted as an 
article of faith that there would be differences in the way 
the implementation processes were carried out in various 
commiinities 9 and that it would be possible to make sense 
of each local variation if we would permit local persons 
(the natives) to describe and explain what was happening. 
The concept of cultural relativism thus operated in tandem 
with the ethical principle of trusting persons as sources of 
data. The researchers felt it was inappropriate to judge 
the worth or efficiency of an open classroom approach to 
implementation with, for example, the standards applied to 
evaluating the impact of a behaviorist approach. However, 
the researchers hold the belief that persons with direct 
hands-on experience could speak cogently from their own 
experience about what worked and what didn't work. 

In our interviews and observations we are also like 
the anthropologist in that we have tried to determine what 
is standard operating procedure for the people in the setting 
we are observing. Much of this standard operating procedure 
is not codified, articulated or iirritten down. Some of it is 
so taken for granted by participants that it is invisible to 
them. The concept of culture has been likened to the image 
of water bein^j invisible to the fish. Culture is the medium 
in which human affairs take place, just as water is the 
medium in which ichthyological affairs take place. Thus, 
anthropologists in their efforts to describe cultui'al 
phenomena sometimes appear to be concerned with matters 
that are obvious or taken for granted. Often it is just 
these matters that are so obvious and taken for granted by 
insiders that can be importemtly illuminating to outsiders. 
In the case of this study, experienced Follow Through practi- 
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the Follow Through context who are now designing or starting 
the process of implementing innovative educational programs. 
It is important to try to document what has been learned by 
those who have experienced first-hand the frustrations and" 
accomplishments of trying to change schools. 
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NOTE: This is a selective list of references that deal with 
the Follow Through program itself or with more general educa- 
tional and methodological issues in a msmner that importantly 
influenced this paper • In addition to these references, the 
national evaluation of Follow Through has been producing a 
series of technical, reports under contract with Stanford 
Resesirch Institute of Menlo Park, California and Abt Associates 
of Cambridge, Massachusetts, The classroom observation studies 
of Jane Stallings at Stemford Research Institute address imple- 
mentation issues. More information about the national evalua- 
tion results and other aspects of the Follow Through program 
can be obtained from: 

Rosemary Wilson 

Director, Follow Through Program 
U. S. Office of Education 
Regional Office Building 3 
7th and D Streets, S. VT. 
Washington, D.C. 20202 



